Master-equation analysis of accelerating networks 
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In many real-world networks, the rates of node and link addition are time dependent. This obser- 
vation motivates the definition of accelerating networks. There has been relatively little investigation 
of accelerating networks and previous efforts at analyzing their degree distributions have employed 
mean-field techniques. By contrast, we show that it is possible to apply a master-equation approach 
to such network development. We provide full time-dependent expressions for the evolution of the 
degree distributions for the canonical situations of random and preferential attachment in networks 
undergoing constant acceleration. These results are in excellent agreement with results obtained 
from simulations. We note that a growing, non-equilibrium network undergoing constant accelera- 
tion with random attachment is equivalent to a classical random graph, bridging the gap between 
non-equilibrium and classical equilibrium networks. 
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I. INTRODUCTION 

In many real-world evolving networks the rates of node 
and link addition differ, a phenomenon that gives rise to 
the concept of network acceleration [H 0, L3, 0| • Examples 
include the Internet @, i, 0K the World Wide Web Q 
and collaboration networks J9jand these have prompted 
some recent scrutiny P, 0, However, the majority 

of network research to date has overlooked acceleration, 
with many non-equilibrium network models focusing on 
the rather specific scenario of adding a fixed (expected) 
number of nodes at each timestep with a fixed (expected) 
number of links to the existing network [l(| [ll|, [l2j • 

Accelerating networks also appear in biology. The 
evolution of gene regulatory networks has been inter- 
preted as a form of network acceleration [l|, [l3[ . Studies 
have shown that the number of regulatory genes scales 
quadratically with genome size in prokaryotic microor- 
ganisms [li], [H| • In these networks, the number of links 
also scales quad ratically with the number of nodes (oper- 
ons/genes) [13]. Indeed, gene regulatory networks have 
provided significant motivation for the investigation and 
definition of accelerating networks [l], [U|, [HI, [H, \vf\ . 
Gagen and Mattick proposed that the apparent accel- 
erating nature of gene regulatory networks in prokary- 
otic organisms imposes an inherent size constraint on 
the system and this is consistent with empirical obser- 
vations [13, El- 

For an evolving (unweighted) network, acceleration is 
related to the rates of link and node addition [35| . Con- 
sider a network comprising N(t) nodes and M(t) links 



at some time t. We now add n(t) nodes and m(t) 
links to the system such that, at the next timestep, 
N(t+1) = N(t)+n(t) and M(m) = M(t)+m(t). Some 
previous investigations of accelerating networks have as- 
sumed that the rate of node addition is n(t) = 1 and that 
the expected rate of link addition is given by some power- 
law function of time (m(t)) oc t@ , where the exponent [5 
describes the nature of the acceleration [H, [H, Hj] . Indeed, 
Gagen and Mattick defined network acceleration in terms 
of this parameter [3t| . However, Smith et al. proposed 
a more conventional definition of network acceleration 
that is a time-dependent property of the system [2j. For 
an unweighted network, acceleration is simply related to 
the rates of node and link addition, more specifically, the 
time derivative of the velocity-like quantity m(t)/n(t). 
For a deterministic system (as in an empirically observed 
network), network acceleration can be written Q 

M(t + l)-M(t) M(t)-M(t-1) 
~ N(t+ 1) -N{t) ~ N(t) - N(t - 1) 

n(t) n(t - 1) ' 1 1 

When considering a stochastic system, the definition is 
more delicate 2]. For the scenario in which the num- 
ber of added nodes per timestep is constant (n(t) = n) 
and the expected number of links added per timestep is 
independent of the particular number added at the previ- 
ous timestep, we can rewrite Eq. £1} for a stochastically 
evolving accelerating network as [2| 

(«(t)> = (m(t)) - (w(t - 1)) . (2) 
n 
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This definition of network acceleration was supported by 
a case study of the evolution of Wikipedia that undergoes 
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different accelerating regimes throughout its evolution Q 
and this is the definition we shall adopt in the following. 

In Section |TT] we review the use of an existing mean- 
field technique to analyze accelerating networks and dis- 
cuss its limitations. In Sections Illll and HVl we consider an 
alternative master-equation method and demonstrate its 
relevance by applying it to the scenarios of constant ac- 
celeration with random and preferential attachment. We 
derive full, time-dependent solutions for the evolution of 
the degree distributions of these networks and compare 
them to simulated networks. We conclude in Section IVl 



II. LIMITATIONS OF SOME MEAN-FIELD 
TECHNIQUES 

For non-accelerating, non-equilibrium networks there 
are two conventional methods to obtain degree dis- 
tributions: the mean-field and master- equation ap- 
proaches on m m m. The former assumes that both 

node degree and time are continuous and the latter uses 
a continuous time approximation. 

The mean-field approach tracks the evolution of the 
degree of an individual node throughout the network's 
evolution. The analysis consists of two distinct stages. 
The first stage is to derive the expected degree of an in- 
dividual node in the network at a particular time, based 
upon the time at which the node was added. At each 
timestep, a single node is added to the system. The pro- 
cess assumes that a node's degree is continuous and that 
links are added continuously throughout the network's 
evolution. The expected rate of change of the degree 
of an individual node is related to the probability of it 
receiving links throughout the dutation of the network's 
evolution. At any given stage during the network's evolu- 
tion, a node added at a particular time will have a certain 
expected degree. This is used to generate a continuous 
expected degree as a function of the time at which nodes 
are added to the system. The inverse of this function pro- 
vides a time of addition to the system corresponding to 
that expected degree. The second part of the process is 
to derive a continuous degree distribution for the result- 
ing network. In many growing network models, old nodes 
tend to have higher degrees as they have longer to accu- 
mulate new links. Consider selecting a node at random 
in such a network. The probability that it has expected 
degree greater than some value k a is simply the proba- 
bility that it was added before the time corresponding 
to expected degree k a . A cumulative degree distribution 
is thus obtained by assuming the time at which a ran- 
domly selected node was added to the network will be 
uniformly randomly distributed across the timescale of 
the network's evolution. The continuous degree distri- 
bution is then derived by differentiating the cumulative 
degree distribution. 

This was the technique used by Barabasi et al. [Ill H(| 
and it has also been applied to accelerating networks 
[H S EH, E2] • This method was also adopted by Gagen 



and Mattick for analyzing accelerating networks 
However, this technique can be inappropriate in certain 
situations. To highlight the shortcomings of this ap- 
proach, we consider its application to the scenario of con- 
stant acceleration such that the acceleration is a(t) = a 
[3?| and that the continuous (deterministic) rate of link 
addition is m(t) = at. For an initial seed comprising 
N(0) nodes and M(0) links, the total number of nodes 
in the system is N(t) = N(0)+t ~ t, the total number of 
links is M(t) = M (0) + f* m(t)dt ~ 2|! and the mean de- 
gree of the network is 2M(i)/N(t) ~ at (where ~ means 
asymptotically equal to). Consider the case of random 
attachment in which all new (undirected) links are made 
between newly introduced nodes and randomly selected 
nodes within the existing network and no connections are 
established between existing nodes (leading to the con- 
straint a(t) < 1 as the number of newly introduced links 
cannot exceed the number of existing nodes). Using the 
mean-field technique, the continuous rate of change of 
the (continuous) expected degree of some node a can be 
expressed in terms of the probability that it acquires new 
links EH]: 

dt V 1 ' 

Integrating from the time at which the node was added 
to the system t a to time t yields the expected degree of 
this node: 

(k a (t)) ~ at. (4) 

The expected degree of node a is asymptotically indepen- 
dent of the time t a at which it was added so the expected 
degree of all nodes is (k(t)) ~ at. It is argued in Ref. [l[ 
that the continuous degree distribution derived from the 
mean-field approach for this system is, therefore, a delta 
function at degree at. 

For the scenario of preferential attachment, the ends 
of the new links associated with new nodes connect to 
existing nodes preferentially according to their degree. 
Again, using the mean field technique, the rate equation 
describing the evolution of the degree of some node a at 
time t for this process can be expressed as 

d(k a (t)} m(t)k a {t) 

dt ~ 2M(t) ' ( ' 

Integrating between the appropriate limits provides the 
same expected degree (k a (t)} ~ at which is asymp- 
totically independent of the time the node was added 
and, consequently, the same for all nodes in the system. 
Again, it is argued in Ref. [l[ that the mean-field tech- 
nique produces a delta function for the continuous degree 
distribution at at. 

Gagen and Mattick provide a method to retrieve a dis- 
crete degree distribution from a continuous one [l[ . How- 
ever, because the mean-field technique provides identical 
continuous degree distributions, the outcome will be the 
same for both random and preferential attachment with 
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constant acceleration (equations (18) and (31) in In 
practice, however, simulations of these networks gener- 
ate very different degree distributions as illustrated in 
Fig. [TJ Concerns over the above treatments motivate the 
approach below. 

III. RANDOM ATTACHMENT WITH 
CONSTANT ACCELERATION 

We now employ a master-equation method to derive 
the degree distribution of a random attachment network 
undergoing constant acceleration. The method was in- 
troduced by Krapivsky et al. [23| and independently by 
Dorogovtsev et al. [2J| to derive the steady-state degree 
distribution of the Barabasi-Albert preferential attach- 
ment mechanism [ldj |. A similar technique based upon 
distribution kinetics has been applied to accelerating net- 
works [25] and, recently, a master-equation method was 
developed to investigate the emergence of correlations 
within evolving networks [26| . Justifications for using 
such an approach are discussed in Refs. [27( and [281 ] . 

Consider the scenario of constant acceleration, (a(t)) = 
a (assumed <C 1), for a stochastic accelerating network 
in which the rate of node addition per timestep is con- 
stant at n(t) = n = 1 and the expected number of added 
(undirected) links per timestep is (m(t)) = at. Since 
N(t) ~ t and a <C 1, it follows that the expected number 
of new links added per pre-existing node per timestep 
( ^iV(tj^ ) ^ s a l wa Y s small. We consider the example of ran- 
dom attachment and all the newly introduced links are 
established between the new node and the existing net- 
work. There are no links formed between existing nodes. 
The process is governed by the attachment probability 
kernel Ofc(i), defined as the probability that a specific, 
newly introduced link connects to an existing node of de- 
gree k. At some time t, there exist Xk{t) nodes of degree 
k and we wish to compute the expected number of nodes 
of degree k at time t + 1. The fraction of nodes of degree 
k is ck(t) = X k (t)/N{t) = X k (t)/[N(0)+t] ~ X k (t)/t. 
It is assumed that the seed component comprising iV(0) 
nodes is small. The master equation for the evolution of 
Xk can be expressed in terms of the attachment kernel 
and is written 

(X k (t + l)) = X fc (t) + (m(t))e fc _i(i) 

-(m(t))Q k (t)+P{m(t) = k}. (6) 

The second term on the right-hand side reflects the ex- 
pected number of connections to k — 1 degree nodes mak- 
ing them nodes of degree k. The last term is the proba- 
bility that the new node itself is a node of degree k. 

To establish P{m(t) — fc}, it is important that the mi- 
croscopic mechanism governing the network's evolution 
be specified. In simulating such a network, we proceed 
as follows: links between the new node and all N(t) exist- 
ing nodes are considered and established with probability 
a satisfying the requirements for the expected number of 
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FIG. 1: (Color online) Degree distributions for stochastic 
random attachment (RA) and preferential attachment (PA) 
networks undergoing constant acceleration. Each simulation 
comprises a network grown to Ntot = 10 6 nodes with mean 
degree of A = 10 ~ aN to t- Also illustrated is the Poisson 
distribution with the same mean and the analytic expression 
of Eq. (|13p for the preferential attachment, constantly accel- 
erating network derived in Section HVl The numerical imple- 
mentation simply generates the degree distribution through 
iterating the master equation, Eq. (|10p . The non-accelerating 
degree distributions for random and preferential attachment 
(Eqs.[^land ll5p with the same mean (m = 5 links added with 
each new node) are also illustrated to highlight the effect of 
accelerating behaviour. 



links for the new node as (m(t)) = at. Interestingly, a 
network generated via this mechanism will also have the 
property that every possible link between every pair of 
nodes will exist with equal probability a. This is equiv- 
alent to the classical random graph studied by Erdos 
and Renyi [29[ and subsequently Bollobas [3(| with iden- 
tical binomial degree distribution. That is, a growing 
(non- equilibrium) network undergoing constant accelera- 
tion with random attachment is equivalent to the classical 
random graph, bridging the gap between non- equilibrium 
and classical equilibrium networks. This is illustrated in 
Fig.[T]where a simulated, random attachment, stochastic, 
accelerating network with constant acceleration grown to 
Ntot = 10 6 nodes is compared to the Poisson degree dis- 
tribution Cfc = e fc , A of the random graph [l2j where A is 
the mean degree of the network. In Fig. [U the mean de- 
gree is A = 10. The acceleration parameter is solved for 
by setting A = 2 ^f tot ~ ^f- ~ aN tot so the acceleration 
is a = X/Ntot which subsequently determines {m(t)). 

To apply a master-equation approach we start by defin- 
ing the random attachment probability kernel, ®k{t) = 
Xk{t)/N(t) = Ck(t) for an individual new link attach- 
ing to any node of degree k within the existing net- 
work. For the random attachment mechanism outlined 
earlier, the number of new links added with the new 
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node will be binomially distributed and, if we assume 
that t is large, we can make a Poisson approximation so 



that P{m(t) = k} = 



'(at) 



Non-accelerating net- 



works can have a steady-state degree distribution in the 
long-time limit and often it is this solution which is in- 
vestigated from the master equations (for example see 
Ref. [2a|)- However, for accelerating networks, the de- 
gree distribution evolves and a time-dependent solution 
must be found. The fraction of nodes of degree k is given 
by Cfc(i) = Xk(t)/N(t) ~ X k (t)/t and, using the continu- 
ous time approximation {X k (t + 1)) —X k (t) w ^L^Ml ^ 



at 



= atck-\{t) — atc k (t) + 



df 



A:! 



(7) 



The time-dependent solution of Eq. ([7]) gives the degree 
distribution for this model and is simply 



Cfc(i) 



k\ 



(8) 



as would be expected for a random graph with mean 
degree of A ~ at in the large size limit [3(j. While 
this master-equation approach does not necessarily imply 
that a given evolving network will converge upon the so- 
lution, in practice this is often the case 3l|. The Poisson 
solution of Eq. ([8]) is compared to a simulated network 
in Fig. [lj 

The effect of the accelerating nature of the ran- 
dom attachment network can be appreciated by com- 
parison with a conventional, non-accelerating scenario. 
The master-equation analysis, when applied to a non- 
accelerating random attachment network with m(t) = m 
(m integer), gives a steady-state (long-time limit) degree 
distribution for k > m of 



1 



Cfc 



1 



1 



k — i 



(9) 



This is illustrated in Fig. [T] for mean degree of 10 
corresponding to m — 5 links added with each new node. 
The mean-field technique applied to the non-accelerating 
scenario produces the (less accurate) steady-state degree 
distribution c k oc e 1- ™/m fl9j |. 



IV. PREFERENTIAL ATTACHMENT WITH 
CONSTANT ACCELERATION 

In this section, we apply the master-equation method 
to the scenario of a constantly accelerating network 
with linear preferential attachment. Again, the net- 
work evolves through the addition of one new node per 
timestep, n(t) = n = 1 such that, for a (small) initial seed 
component of iV(0) nodes, the total number of nodes is 
N(t) — N(Q) +t ~ t and links are formed between this 
node and the existing network. With constant acceler- 
ation, (a(t)} = a, the expected number of added links 



per timestep is (m(t)) — at. For both simulation and 
analysis, a clear description of the microscopic process is 
necessary. We assume that the desired resulting network 
is sparsely connected, i.e. the resultant mean degree is 
significantly less than the size of the network. As such, 
(m(t)) <C N(t) (equivalent to o < 1) and the attachment 
process can be modeled as a series of Bernoulli trials. All 
links between the new node and existing nodes in the 
network are considered. The probability of a link being 
formed between the new node to some existing node <; 
is set to be (m(t))k q /2M(t). By performing this ran- 
dom trial for all nodes within the existing network, both 
preferential attachment and the expected number of new 
links added (m(t)} = at are preserved. Nodes with zero 
links when introduced to the system will remain degree 
zero throughout. 

Analysis of this process starts by writing the master 
equation. For the purposes of analysis, it is assumed 
that the total number of links in the network is well ap- 
proximated by its expected value, M{t) « (M(t)). Us- 
ing the preferential attachment kernel, we have 0&(i) = 
kX k (t) /2(M(t)) and the master equation for the evolu- 
tion of the network can be written 



(X k (t+1)) = X k (t) + 



(k-l)(m(t)}X k ^(t) 



k(m(t))X k (t) 
2(M(t)) 



2(M(t)> 

+ P{m{t) = fc}.(10) 



We derive the probability P{m{t) — k} in a similar 
manner to the random attachment scenario. Consider 
the nodes of degree j in the existing network at time 
t. There are Xj(t) of them. All Xjit) possible links 
are considered between the new node and these ex- 
isting nodes of degree j and each is established with 
probability j(m(t))/2(M(t)). Consequently, the number 
of new links between the new node and what were j- 
degrec nodes will be binomially distributed with mean 
j{m(t))X J (t)/2(M(t)}. The probability distribution for 
the degree of the new node will be a convolution of all 
these binomial distributions corresponding to each value 
of j. However, if we assume that Xj(t) is large then 
we can make a Poisson approximation for each of these 
binomial distributions. The convolution of two Pois- 
son distributions is a Poisson distribution with a mean 
equal to the sum of the means of the two. As such, 
the probability distribution for the degree of the new 
node can be approximated by a Poisson distribution. Of 
course, the mean of this is simply (m(t)} and, conse- 
quently, P{m(t) = k} is the same for both preferential 
and random attachment. Recalling that (M(t)) ~ sL. 
and that the fraction of nodes of degree k is given by 
c k (t) = X k {t)/N{t) ~ X k (t)/t, the master equation of 
Eq. (fTQ|) for the evolution of a constantly accelerating 
network with preferential attachment can be rewritten 
as 



d(fc fc (f)) 
dt 



(*-l)cfc_i(i)-fccfc(t) + 



(aty 



k\ 



(.11) 
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Multiplying both sides by the integrating factor t k , this 
can be further simplified to 



d ^W) = (k-l)t*c k Mt) + e ~ at{at2)k 



dt 



k\ 



(12) 



The recursive nature of Eq. ([12]) means that the solution 
can be expressed in terms of repeated definite integrals 
back to the expression for c\ (t) . Each of these integrals 
equals zero when evaluated at the lower limit allowing 
the time-dependent degree distribution to be written (see 
Appendix [X] for details) as 



' "~ tk+1 tr{ x\(x - i)\(k - x)\ J 



/ , \k — x/ 2\x —ay j 

(t - y) (ay ) e "dy 



be modeled as a non-equilibrium evolving network, more 
specifically a constantly accelerating network with ran- 
dom attachment. 
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APPENDIX A: ANALYTIC SOLUTION FOR 
CONSTANT ACCELERATION WITH 
PREFERENTIAL ATTACHMENT 



(k - iy.(2x)\(at) x 
x\(x - l)\{k + x + 1) 



E 



-iF![l + 2x,2 + k + x, -at], 



(13) 



where ±Fi[k, p,cj>) is the confluent hypergeometric func- 
tion of the first kind, or Kummer's function, defined (for 
integer k and p) as [32| 



As detailed in Section HVl the master equation for the 
evolution of the degree distribution of a constantly accel- 
erating network with preferential attachment is given by 
Eq. ([12]) . For clarity, it is useful to write the last term 
on the right hand side as a function: 



G x (t) = 



e- at (at 2 ) x 
x\ : 



(Al) 



iFi[n,p, 



(p-iy- 



(p- «-!)!(« -!)!./„ 



(14) 



such that the master equation can be rewritten as 

d(i fc+1 c fc (;)) 



dt 



(fc-l)t*Cfc_i(t) + G fc (i). (A2) 



Comparison of the analytic solution Eq. (|13p is made 
to a simulated network in Fig. [TJ The simulated network 
was seeded with two connected nodes and has accelera- 
tion a = 10~ 5 . 

To highlight the effects of network acceleration, 
the master-equation analysis, when applied to a 
non-accelerating preferential attachment network with 
m(t) = m (m integer), provides a steady-state (long-time 
limit) degree distribution for k > m of [ll| 



We can separate the variables and integrate Eq. (|A2[) to 
give 



Ck(t) = -^j-i J (k - l)ti fc c fc _i(ii)dfi i / (V, if, ),(-/-., 



1 [ Jo JO 

Making the substitution k = k' + 1 yields 



Ck'+l(t) = TT7 



k't 1 k ' +1 cy(t 1 )At 1 + I G k > +1 (ti)dti 



Ck 



2m(m + 1) 
fc(fc + l)(fc + 2)' 



(15) 



This is illustrated in Fig. [T] for mean degree of 10 
corrsponding to m = 5 links added with each new node. 
The mean-field technique produces a power-law degree 

2 

distribution, Ck oc Tpr, in the steady state for large k 



V. CONCLUSIONS 

We have demonstrated that the master-equation 
method can be applied to accelerating networks, high- 
lighting the importance of specifying the microscopic pro- 
cesses taking place within the evolving network under 
scrutiny. We have provided full time-dependent solutions 
of the evolving degree distributions for random and pref- 
erential attachment with constant acceleration. We note 
that the classical random graph of Erdos and Renyi can 



1 I Jo Jo 

We now evaluate this expression explicitly for the first 
few values of k' = 0, 1, 2, 3 to generate the degree distri- 
bution for the nodes with degrees 1 — > 4: 

i r t 

«1 t = / G 1 (t 1 )dt 1 , 

t 2 JO 

C2(t) = ^{/o7o tlGl(t2)dt2dtl+ /o tG2(tl)dtl }• 

C3(t) = pr{/o7 tl yT 2Gl<t3)dt3dt2dtl 

+ / I* 1 2G 2 (t 2 )dt 2 dti 
JO JO 

c 4 (t) = 4rl P P 1 P 2 P 3 3 x 2Gi(t 4 )dt 4 dt 3 dt 2 dt 1 

t 5 [ Jo Jo Jo Jo 

+ P P 1 f 2 2 X 3G 2 (t 3 )dt 3 dt 2 dt 1 

Jo Jo Jo 

+ /' P 1 3G 3 (t 2 )dt 2 dt 1 

Jo Jo 



' lo G4(tl)dtl }- 



(A3) 



We tabulate the coefficients and number of repeated in- 
tegrals for the contribution of each G x (t) to each degree 
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distribution value Ck in Table U using the notation (/, g) 
such that / represents the coefficient and g the number 
of repeated definite integrations undergone. By inspec- 
tion from Table HJ we can write the solution of the time- 
dependent degree distribution as 



(fc-l)! 
(x-1)! 



G x {t 



k-x+l 



)dt h - 



x+1 



k-x+l 



all equal in value. This allows further streamlining of the 
expression for the degree distribution as the following 
identity holds for the repeated integral [34j : 



A'/ 

A .Jo Jo 



G x (tk-x+i)dtk-x+i ■ ■ ■ dti — 



r 

Jo 



Gx(y)(t-y) k - 



(k- 



-dy. 



(A5) 



(A4) 



Each integral, when evaluated at the lower limit, is al- 
ways zero as G x (0) — for all x. The upper limits are 



Substituting back in the expression for G x (t) , the distri- 
bution of Eq. (|A4|) can now be written as in Eq. (E 
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The definitions we use here can be easily extended to 
incorporate weighted links 0]. 

The definition of Gagen and Mattick suggested the func- 
tional form (m(t)) oc Nit) 13 which, for the addition of one 
node per timestep, has N(t) ~ t and this is the scenario 
they analyzed in Ref. 0]. 

In the investigation of Gagen and Mattick, this scenario 
was described as a 'hyper-accelerating' network [lj. 
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Gi(t) 


G 2 (t) 


Gs(t) 


G 4 (t) G 5 (t) G 6 (t) 


Ci(t) 


(1.1) 








C2(t) 


(1,2) 


(1,1) 






cs(«) 


(1x2,3) 


(2,2) 


(1,1) 




c 4 (t) 


(1 x 2 x 3,4) 


(2 x 3,3) 


(3,2) 


(1,1) - 


C6(t) 


(1 x 2 x 3 x 4,5) 


(2 x 3 x 4,4) 


(3 x 4,3) 


(4,2) (1,1) - 



ce(i) (1 x 2 x 3 x 4 x 5, 6) (2 x 3 x 4 x 5, 5) (3 x 4 x 5, 5) (4 x 5, 3) (5, 2) (1, 1) 

TABLE I: The contribution of the functions G x {t) to the values of the degree distribution c k (t). The notation (/, g) is such 
that / is the coefficient and g is the number of repeated integrals. 



